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ABSIBACT 

The purpose of this study vas to ezaaine the factor 
structure stability of the Student Evaluation of College Teaching 
Behaviors (SECTB) , a 60-itea, lov inference type of student rating 
ijistzuaent designed to assess college teaching ^behaviors* ihile the 
original factor structure! vas based on the responses of both faculty 
and students, including bOTh undergraudate and graduate students 
across several subject aat^gr fields, the current study focused on 
1116 priaarily aale (74S) freshaen (66X) in one subject aatter fi^ld. 
Ja^theaatics) • Only one factor (currency of knovledge) held up 
vithout auch change* The results tend ito indicate that factor , /i 
analyses should be obtained for the SECTB and siailar lov inference 
itea type instruaents for each instructional unit and subject aatter ^ 



area vithin a college* (Author) 
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Abstract 



The purpose of this study was toexaraine the^factor »sti\icture stability of 
. the Student Evaluation of College Teaching Behaviors (SECTB>,fa 60* item, low 
inference typ,e of-student ratiij^g instrufflent designed to assess«^oHege teaching* 
behaviors. While the original factor structure was based dn the responses of 
'both faculty and students, including both undergraduate and graduate students 
across several subject matter fields, the current study focussed on llli? primarily 

' ' r . . 

male (74%) freshmen (66%) in one subject matter field (mathematics). Only one 
factor (currency of knowledge) held up without much change. The results tend j- . 
to indicate that factor analyses should be obtained for the SE(*rB and similar 
low inference item type instruments for each instructional unit and subject 
matter area within a. college. 
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. Student Evaluation of/(Jpllege Teaching Behaviors 
(SECTB) Instrument: / ^ Investigation of Factor 
^ Structi^jrfe Stability 

■ ■ /I'. , ■ 

The systematic use of. stuc^erft evaluations of college teaching has 
increased dramatically in recent fyfears . Austin. and Lee in 1967 reported 
only 12,4% of 1100 college and' universities using syjstematic student \ 
ratings^ in all or most departmen'ts • Creager (1973), in his study of 669 
institutions six years lat^r, faund 64,3% using them. One result has 
been a plethora of student/ rating forms. Many, perhaps most, of them ask 
the student to make somewh/at global assessments of his instructor's 
characteristics, Tliat is.;^mo^t instruments contain high inference type, 
ite^ such as: "How well/ doe^' the instructor seem* to know the subject?" 
AltHiough such instrument? usu^^ly have 1±e advantage of- short administra- 
tion time due to a small/ numbfer of such items, they are oftt 
'tiie problems of "response set*' and "ha^o effect." 



ten prone to 



The Student Evaluation ibf College Teaching Behaviors (SECTB) was 
developed as an attempt to' deal with the above problems (Greenwood et. 
al.,. 1973). It contaihs 60 low inference items that cfescrib^ specific 
teaching bfehaviors, irfcl/uding both negative and positive type^behaviors 
and^asks the student tp/tnake a dichotomous choice. as to whethei or not 
the item describes thjfe; /Instructor's teaching behavior. The student 
marks, only those' itert^ /that he considers to be relevant to the course 
and the instructor- ' /// ' , ^ 



nj|)irj.cariy derived from a large sample o} students, 
""tgrs, who were asked to describe the six character- 
worst 'college instructors they have known (Bridges 
ehavioral items were then generated from the categories 
J^tained. These we^e rated by faculty and students in 
ionship to good or bad college teaching, and examined 
/ for behavioral specificity, A final pool of 60 
f^re submitted to factor analysis. Such high agreement 
was found betweenfltud'ents and faculty when their i:e$ponses were factor 
an'^lyzed sepax'at^|^, that their responses were poole<J into one composite 

Id^ng eight factors. Tab-le 1 summarizes the original 
ture (Greenwood et al . , 1973) , . ^ 
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Subjects ^ 



f this sfudy was to examine the stability of the SECTB 
The loriginal factor structure was based on the , responses 
=554) and students (n=328) , including both' graduate and 
enfs representing several subject matter fields. This 
[undergraduates in one subject matter field at the same 
university in'which th.^ original study was done. 

Method 



Subjects v^^re 1116 undergraduates enrolled in 3a/sectioiis <ff an under- 
graduate analytjic geometry aad calculus course during ,the fall quarter of 

( 4 ' V 



1974. The students were mostly lower *di vision* (66% freshmen and 16% 
sophomores) and male (74%), * ^ ^ 

Data Collection . - w • 

The SECTB was administered during the ninth^v^eek of a twelve week 
term. |^Students were' given the usual 'assurances that instructors would see 
group lata only and then only' after the course^ was over and grades had 
been turned in- The SECTB was administered by specially trained faculty 
and students over^a two -day period and cours,e instructors were not present 
at the time, , ^ 

Analysis and Results 

Factor analysis was perfoi-med using Gator ' Education Library programs 
EEL501 and EEL503 (Guertin wd Bailey, 1970), In the 'case. of the data 
reported here,^ nine factors were rotated using varimax rotation and the 
customary eigen 'value threshold of 1,00, 

. The rotated factor structure for the data is' shown in Table 2, 
Considerable change in the factor structure is noted when Table 1 is 
'compared with Table 2, Only one factor (Currency of Knowledge) seemed to 
hold up well, while the original Commitment to Teaching and Evaluation ' I 
factors seemed to merge with items from some of the original factors . ' ' 
(especially Rapport and Obsplescence of Presentation)' and split into two 
clusters each": The original Facilitation of Learning factor blended, into ^ 

the new Clarity and Organization and Instructor-Student Interaction facr > 

:tors. The original Voice Communication and Openness factors were completely 
subsumed by new clusters. New factor #8 (Early Communication of Assignments) 
consists of 'bnly one item (#39) with a loading of 0,9121. 

Factor I describes an instructor who is not committed to the students 
he teaches,. He not only complains about his. teaching assignment and ^ails 
to orepare himself for class, but he behaves in a dogmatic and negative man- 
ner^oward students^, communicating his lack of concern for them. 

Factor II is descriptive of a well organized iijg^p^tor who plans 
ahead, communicates his plans clearly, and presents the Subject matter in 
a clear, understandable manner. He hasC^no problem in dealing with student . . 
questions , 

Factor III is indicative of 'an instructor who interacts effectively 
with his students. He not only encourages student response in the classroom 
thrqiigh a v.ariety of stimulating behaviors hut he also relates effectively 
to students outside the classroom. ' • 

Factor IV p^resents^an i 1.1 -prepared, unmotivated instructor somewhat libe 
the one described in Factor I, However, this instructor seems more bored witH 
teaching itself, perhaps due to non-t\aching interests, and does not translate 
his frustrations into dealing with hir students in such a negative manner. 

Factor V describes an instructor who deals with his studenls^ fairly as ^ 
far asibvaluatioo procedures are concerned. He gives students advance notice 
of exams, retunis\ evaldated work promptly, and is willing to discuss and rec- || 
tify errors made,\ •» 
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1 Factor VI -presents behav^iors related to communicating the means of . 

I evaluation in ^the course. The instructor effectively communicates the 

"determine whether or not the objectives have been met. further, students * 
are able to present their own opinions on objectives and evaluation proce-^ 
*dures . - , 

Factor VII is descriptive of an instructor who not only' has kept 
abreast of current publications, research, and ideas in his. field but is 
able to rdla.te the subject matter to personal experiences. 

^^^ctor VIII is a one item factor that relates to the early assignment 
of such course requirements as reports and term papers. Stadents are told 
of such work at the beginning of the course so that they will have adequate 
rime to work on it. 

Factor IX presents instructor behaviors related to punctuality, not 

only in coming to' class on time t>ut also in keeping outside of class ap4 
pointmehts . • . * H , ' 

* , • . Discussion 

The purpose of this study was to exaftiine the stability of ^the factor ^ 
. . structure of an instrument with low inference type items when used with an 

. . undergraduate (as opposed to a mixture of both graduate and undergraduate). ^ 

male (74%) -popluation in one subject matter field (mathemlitics as opposed ' 
to several subject matter fields). 'Only one factor (Currency of Knoviledge) 
held up without much change. These findings would seem to argue that if a 
^ low inference type instrument is. to be used, factor analyses should be ob- ' 
"tained for each subject matter fieljl included in a university's -student 
rating program. * ' 

^- ■ . ■ . . ^ ' ' ' 

It may well be that certain disciplines, especially in .the introductory 
and basic courses, demand highly organized presentations of carefully defined 
processes or factual ^information. Mathematics, for instance, does possess a 
. logical structure that ma^j^P* other areas do not possess. The SECTB factor • 
structure emerging from this study differed from the originatl one in that it 
seemed to place greater emphasis on instructor planning, organi^zed presenta- 
tion, and clear and parly communication of objectives, assignments, and 
evaluation procedures. It seemed to place less emphasis on such, variables y 
as rap]^pjf»trand instructor openness. These two variables may be extremely. . 
. imporfant in disciplirtes such as philosophy and humanities in>hich student 
/V ideas, opinions and interpretations are solicited. If factor analyses 

could be obtained from various fields and at various levels, if may be that 
different variables could be identifi^ed as they relate tp the nature of ■ / 
the discipline and the instructional mode the discipline demands. 

^ . An is^e that might be raised is whether or not 'the factor structures 

of high inference item instruments are more stable than ^hose of low * / " 
^ inference item instruments. Obviously, research on this issue would be 

extremely helpful.' However, low inference- instruments would 'appear to have 
greater usefulness as tools for instructional improvement and ^perhaps, the ^ 
idea of developing separate factor, structure/s ' for each Subject mattelr* field * 
in a college isn't a bad one in any cafe^^^ollege administrators who use 
student ratings as a basis for making iiadgments about col lege< teaching - 
» effect iveneS^ovould do well to encoiii|gte research on fa(;tir struC<;ure 

^ stability rigjJp'along with research vDn instrument reliability and Validity ^\ 
A different sW of factors may emerge for each departmeift (and for each 
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j . , ,Table 1 . .. _ ^ 

:.i-:actor Arrays of. -Ei gilt -Varimax Factors 



Jtem Loading 
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' .562 
.558 



25 
32 

36. 



4Q- 
"48 

s/, 

59 
8 



'Statement 

' r ' . ■ ■ , 

^fcqtor L: Tacilitation pf Learning 

Gave ,,organized^^.answers J:o complicated questions in class 

' Permitted students to expre3S opinions which differed- from, 
' his/hgr own o J , 

^ Encouraged students to Jfek questions 

Dealt with student difficulties before they arose 

Utilized background of students to ai#in/class activities 

Encouraged cl^ss discussions 

Explained the' reasons for his/her criticisms 

' Delivered orderly, logical* presentations of the material 

Factb.r II: OBsolescenfee of Presentation 

' ■ * • ^ ' ' - * . ! 

Would not deal with qu^tions covering material beyond text 

Tested primarily for isolated and/or obscure details 
/ .352 - Presented obsolete material , * - 

-• ^ ' 

•564 V Frequently read aloud from the textbook 

'Presented facts without relating them to ofle another 
Class^^esentations were primarily reiterates of textbook • 
Read extensively from his/her lecture, notes i' 
Lacked knowledge of subject being pres6nted^ 
Presented. irrelevant* material -during lectures 
Factor III: Cbmmitment to Teaching 

Missed cl)ass often "due to non-teaching resjjpnsijjilities ■/ 
Permitted students to disriipt classroom activitr^s 



12-; 


.^26 


27. 




38 


*.424 ° 


51 


,570' 


54 


".509 . 


56 










.510 ' 


10. *. 





.327 
.616 
.630 
:349 
,334 

."328 
.475 



♦ 



Factor III: Commitment to Teachimj (cont 



" --rtera 

42 
44 
45 
57 
59 

2 : 
10. 
15 
16 
33 
34 
37 
>• 39 




goading 
-.503 
-.386. 
-:345- 

,607 ' 

^.5'S5 ^ 
.327 

' .405 
-.341 
.545 



A. 310 



.330 
.639 
349 
.492 



.382 
.734 
.608 

.634 

;.799 



24 
29 
31 



.4io 

.550 
.487 



Statement ' _ * 1: ' • - * . 

_. . . ^_ _ _ . 

Spoke, with poise ^ , ' 

Remained un.riiff led by student's questions 

fj^ained laHout his/her teaching assignment"*' ' , ' 

Was late -to - wass - y - / 

Came ^to appointments on time * ^ 

• »■.• 

• Presented ir^eleyant material during lectures 
Factor. IV ^ Evaluation l» - . . 

Told students What was^. expected of fhem* * 
Tested primarily for isolated and/or obscure- details ^ 
Explained how grading was done 

% ^ t 

Provided feedback oh student work prompt|y 

Established. and kept office hours for individual conferences 

Gave tests which cpuld be com pleWd within Ahe' Allotted time 

Gave clear,, reasoniable assignments * . / 

Informed "students of reports , teiTir?papers at the beginning 
of the cdurse* 

Stated course objectives 

\' ^- • . " . - 

Stated basis by which grades. wer^ determined 

■ - t ' " ■ ---- 

*• Announced ^exams in advance - % 

Factor V: Voice Communication " 

Changed pitch, volume^ or quality of speech 

I Could be heard -in "all 'parts ^of the classroo^ 

r 

Factor VI : Openness . * 



Spok^ distinctly 
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Liitened to student's prbb^lems 

Admitted ^eing" wrong Wlien shown he/she was in ertror^ 
Laughed ^t his/her own mistakes '' 



^Loading \^ Statement ^ ' . ^. ^ 

.Factor VII: Currency of Knowjedge * : 
-.33j7 ^ Would not , deal >With questions covering material beyond text 
.550 * Dealt with qud^^tion? covering material beyond te;ct . 
•685 Introduced new ideas and/or research findings in class ^ 

.540.' Gave references to current- publications 
.318 1 Presented material as an extension of the text 
.383 Asked chailenginjg and/or probing questions ' 

378 Stated coursje objectives ' * 

Factor VIII ^^Rapport ^ * . * . ' 



-i391 . Ridiculed students in frbnt of class ' / ' 

^.478 Students could understand profess&r's vocabulary . ' 

• ' ; ■ " , * ■ - '• ' , 

•538 Students could understand class presentation 

.340' ^ Listened to student 's, problems . 'C ' 

-.451 ' ^ Ignored student qwestions " ^ V 

.349 Established and ^kepf office .hours 'for individual, cbrrferences 

-•358 Ins is te^^^t his/her opinions wer^ the only correct ones' 

.429 Permitt^^tudents to complete thought processes/. * . ' 

^.429, ' Evaluated eacl) student as an individii®^ . " ' *' 



Item , Loadiqg 








22 


0.6848 


56 


0.6689 


.21 . 


0:6116 


3 


0.5844 


■ 50 . ' 


0.5687 


, 20'* . 


0.5439 


42' 


0.4612 


37 


0.4584r 


27 :j 


0.4335 


• ^*2 


0.3677 


. 34V 


0.3532 




■ Table 2 • ' • V 

Factor Arrays of Nino Varinjiax i^actors 
Statemeht ^ 

• * ■ , ■■ • 

Factor I: Lack of Commitment to Studerits : 

■ . * • ■ ♦ • .' '^■ 

Complained about his teaching assignmei^t^^^^^'^^^^^^ 

In$isted-that his opinions were the onlx-correct oires 

Accepted and/or used .inaccurate information .' 

Presented obsolete material , 

Penalized students for disagreeing with teacher 

(adiculed students in front of class ' >. 

Ignored student questions - . v 

' Presented irrelevant material during lectures ' • ' 

Frequently read a^/oud fronf^'^ie^extbook ' 

Permitted students to disrupt classroom ^ctl] 
•Admitted lack of knowle4jge 

Facl^ II; Clarity and Organization » • 

Studerfts could understand class presenta^tion,, \ 

Delivered orderly,i logical presentations of the material . ' 

• ■ 

Spoke with poise" • 

"V . . ^ . 

Gave organized answers to complicatod questicrns iii 'cla^3 
Spoke distinctly , ^ ✓ -^"^ ■ 

Students coi/ld understand professor's voc*abularyj '•7-^' 
Remained unruffled hy student's questions. 
Gave clear, reasonable assignnj^Ats^ 
Dealt with student difficulties before they arose 




^tiyitie/^ 



To 14 students^ what he expected ot' them * 



ich couddibe cbjnpleted with the .alloted time • 
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Loading 

O.SOlf 

0.5006 * 

0.4638 

0.4624. 

0.4529 

0.415£»,-^-. 

0.39^7 

013308 

0.3059 

0.5291 

0.a262 U 
-0.4642 

0.4163 

0.4083 

0.3824 

0.3785 
-0.3652 

« 

-0.3087 
-0.30^ 
0.3007 

0,6748 
0.6084 
0.4336 
0.3S64 
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Statement ^ 

Factor III: Instructor • Student*, Interaction 

Could be heard in all parts of classroom 

Encouraged class discussion 

Exp^l^hed thoj reasons for his , criticisrms 

• >• • • . ' * ' 

Asked challenging and/or jirobing questions 

Tplked with 'students cwjppFide of class ' . ' 

Encouraged students td ask questions 

r 

Listefied to student's problems 

Changed pitch, Volume or quality of speecli 

Lead sti|dents to answer wn^ questions , 1^ 

Factor IV: Lack of Commitment to Teaching 

Missed class often due to non-teaching responsibilities 

Lacked knowledge of subject beirxg presented 

Utilized background of students to aid' in class activities 

Presented facts without relating them to one another 

Showed boredom for teaching this class 

% 

Read extensively from his lecture notes 

Tested primarily for isolated and/or obscure details 

Permitted students to complete thought processes 

Evaluated each student as an individual 

Laughed at his own mistakes 

Made no comment (oral or written) on returned papers 
Factor V: Fairness of Evaluation Procedures 
/Vnnounced exams in advance 

Admitted being wrong when shown he was in error 

Esttlblished and kept office hour^ for individual conferences 

Provided feedback on student work promptly 



Item L|(ading Statement , 4 

ftactor VI: Communicatior) of Evaluation Procedures ^ 



15 


0.6870 


53 


0.6624. 












/ ; 

/ 0,5954 


1 X 
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0.5495 


5 


-0.4061 




0.4061 


• 




39 


' 0.9121 




9: ' 






57 


0.7467 


45 


-0.7364 



Explained how grading was done 

♦ * 

Stated basis by which grades were determined 
Stated course objectives ^ ' 




Permitted students to express opinions V^ich differed 
ftora his own ^ ' - ' 

* ' ' ' • ' 

Factor VII; Currency oF Knowledge • ^ 

Gave references, to current publications . ^ / \J 

Intro<luced new ideas- and/or research, findings in class 

Dealt with questions covering material beyx)nd text 

Would iipt deal with questions covering material beyond text % 

often upon relevant personal experiences in 
teaching subject 1 » 

Factor VIII: Early Communication of Ass^nments 

Informed students of reports and terra papers at the 
beginning of the course . # > " 

factor IX: Punctuality 

Came to class and appointments on time 

Was latesto class < 
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